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Abstract. M ap quality refers to the overall characteristics of the map con- 
sidered as a communication and reference medium for measurement and 
deci si on maki ng. The better the qual i ty of the map/ chart the more eff i ci ent 
its utilization by the users community will be. In map quality assessment 
the problem lies with the definition and quantification of the quality char- 
acteristics of the map/ chart which could lead to an overall quantified esti- 
mation. The definition of map quality may be constituted of different pa- 
rameters, which either focus on the consequence of cartographic commu- 
nication and thus provide a holistic description of the communication pro- 
cess quality or concentrate on specific parts like semiotics (for a selected 
purpose of map-use), structuring of semantic map content, primary model 
data-quality (as result of consistency of a database) or similar. Existing 
bibliography refers to a number of efforts addressing the issue of 
map/ chart quality, which deal with certain elements of quality i.e. posi- 
tional accuracy of the portrayed features, but not with an overall quantita- 
tive assessment of the map/ chart. This paper elaborates on the issue of 
map quality assessment and presents part of an ongoing research on the 
development of a map quality evaluation methodology. The formulation of 
the proposed method is based on two assumptions: a. the map composition 
process constitutes of a series of processes/ phases which are performed in 
digital environment b. A map iscomposed through the compilation of data, 
which undergo a number of transformations/ alterations in every phase of 
the map composition process. Map quality assessment will result implicitly 
through the evaluation of cartographic data quality in each and every stage 
of map composition process considering that the input data satisfy mini- 
mum quality criteria. The execution of the map quality model in each phase 
of map composi ti on process wi 1 1 f aci I i tate the eval uati on of the overal I map 
quality. 
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1. Introduction 



Internationally and in the framework of the development of Spatial Data 
I nfrastructures - SDIs there has been an active production and dissemina- 
tion of spatial data by the pertinent authorities. Although still in an imma- 
ture stage geographic organizations adopt processes for the control and 
certification of quality either through the use of internal specifications or 
through the utilization of international standards i .e. ISO spatial data quali- 
ty standards 19113,19114, 19115, 19138, NATO STANAGS, INSPIRE Data 
Specifications etc. Relevant studies based on the national reports to ICA 
show that in the period 2007- 20 11a number of organizations adopted spa- 
tial data quality management systems based on the I SO 9001/2008. 

In spatial data production and especially in the framework of spatial data 
infrastructures, a constant effort in controlling data quality is in place. A 
typical example of this effort is the data quality model developed as a result 
of the ESDIN project (www.esdin.eu), which is based on the ISO 19100 se- 
ries of standards and the INSPIRE specifications on data quality. On the 
contrary, quality assessment process in map production is limited and re- 
search results have been published on quality evaluation of the derived car- 
tographic data mainly due to generalization. Undoubtedly there is no for- 
mal approach for the development of a quality model covering the map 
composition process as a whole. Along with the increase in productivity and 
the wider dissemination of spatial data the publication of maps and charts 
(in printed or digital form) is flourishing. In contrast with quality assess- 
ment of spatial data, which is based on standards, there are no international 
standards relevant to the quality assessment of maps/ charts or official pub- 
lications on this topic. This is despite the fact that throughout the years 
there has been an increasing concern on the identification and assessment 
of the error involved in map production process. Most of the existing speci- 
fications on map quality refer to their horizontal accuracy or the topology of 
the features portrayed (EuroGlobalMap Specifications, EuroRegionalMap 
Specifications, and Australian Map Horizontal Accuracy Standards etc.). It 
is worth mentioning the work done by a number of researchers for the as- 
sessment of change to the input data caused due to generalization (Skopeliti 
& Tsoulos 2001 Ruas 2001 Bard 2004, Cheng & Li 2006, Frank & Ester 
2006, Mackaness & Ruas 2007, and Stoter et al. 2009). The existing bibli- 
ography lacks of an integrated model for the quality assessment in every 
stage of the map producti on process. 

The issue of quality assessment of maps & charts is critical due to the fact 
that there is no indication on their fitness for use. Analyzing the constitu- 
ents of map/ chart qual ity we may i dentify them as fol I ows: 



■ Geometric quality: refers to the degree of compliance of absolute or rele- 
vant positions of the features portrayed on maps/ charts and their geom- 
etry wi th the I i mi ts set i n the sped f i cati ons 

■ Thematic quality: refers to the correctness of the categorization of the 
entities with respect to their attributes and the degree of compliance of 
the attribute values with those provided in the specifications 

■ Aesthetic/ graphical quality: refers to the quality assessment of the map 
portrayal considered as the communication medium and the graphical 
model of the area portrayed. 

From the above three components of quality only the two first (geometric 
and attribute quality) can be assessed and quantified (Ahonen-Rainio & 
Kraak2005). 

Two factors are considered important in producing a map/ chart according 
to the relevant specifications and the users' needs: 

a. The utilization of spatial data of known quality, which will have been 
based on internationally adopted quality standards 

b. The transformations involved and the quality control of the derived data 
in every phase of map composition process. These transformations have a 
considerable influence on the map/ chart data and despite the fact that the 
transformation results have been studied and are described in the carto- 
graphic literature there is no way to assess the quality of the map/ charts 
produced. 

Spatial data of known and acceptable quality is not by itself adequate to 
confer map quality. Therefore the quality level of the input spatial data can- 
not be considered as a quality measure of the resulting map. This is due to 
the transformati ons performed on i nput data i n every phase of map compo- 
sition process. Cartographic data quality control and assessment are the 
only ways to ensure that - in every phase of map composition process - in- 
put data will be transformed in a way satisfying the set specifications and 
will result to a product of known and acceptable quality. Assuming that the 
spatial data used in map composition are of acceptable quality for the in- 
tended scale and the scope of the map/ chart, the effort for the quality as- 
sessment of the map/ chart produced is focused on the transformati ons exe- 
cuted on the input data in the various stages of map composition. In the 
following section a methodology on the quality assessment of maps/ charts 
is proposed through the control of the changes of the characteristics of 
map/ chart data throughout the map compositi on process. 



2. Methodology 

The proposed methodology aims at the typifi cation of the controls required 
for the assessment of map/ chart quality and includes the design and im- 
plementation of a model that will provide quality indicators in every stage 
of the map composition process. The application of this methodology will 
result to the quantification of the quality elements associated with each 
map/ chart. 

2.1. Conceptual framework 

The development of the methodology for the quality assessment of 
maps/ charts requi res: 

■ The structural organization of the control environment where the meth- 
odology will be applied 

■ The design of a quality model that will identify the tools necessary for 
quality assessment, the recording of the results and their synthesis for 
the overall assessment of quality. The term "tools" refers to the quality 
elements, their sub-elements and the corresponding quality measures. 
The implementation of the quality model is complemented with the 
adoption of quality conformance levels and the procedural evaluation of 
determi ni ng cartographi c data qual i ty agai nst the set sped f i cati ons. 

2.1 .1 . Application environment 

The quality control of maps/ charts is considered as a process comparable 
with those executed in a production line according to the ISO 9003/2008 
standard. An inherent element of this production line is map/ chart compo- 
sition divided in discrete phases and executed in a digital environment. 
Each phase i nvol ves certai n transformations of the i nput data leadi ng to the 
composition of the final map/ chart. According to the Quality Management 
System of the production line, quality evaluation of the chart data resulting 
from each discrete phase is required ensuring the integrity of the process. 
Otherwise there is no sense to proceed with the next composition phase. 
This way input data in each phase will be transformed in the way expected 
and the resulting product will be of acceptable quality. It is noted here that 
a non- acceptable result in the process is an indication of the necessity to 
change the algorithm used, the values of the parameters involved etc. 

The above described approach for the quality assessment of maps/ charts 
through the quality evaluation of the result in each phase of map composi- 
tion facilitates the typifi cation of the process, which is necessary for the 
development of the map/ chart quality model. Map/ chart composition pro- 
cess is complex due to the number of algorithms applied, the values of the 



corresponding parameters and the alternative approaches that may be fol- 
lowed for the same cartographic transformation. This leads to different re- 
sults for chart data ori gi nati ng from the same database. 

2.2. Logical framework 

2.2.1 . Identification of quality elements and their corresponding measures 

For the quality assessment of the final product (map/ chart) the I SO 19100 
series of standards for spatial data are utilized. This choice is based on the 
fact that that the map/ chart composition process is implemented in digital 
environment through the utilization and transformation of input data. In 
addition it is adopted that the map/ chart data have the same inherent char- 
acteristics with the spatial data provided and that the cartographic data 
base is a by-product of the spatial data base. This family of standards - if 
they are properly modified and complemented - provides the framework for 
the qual ity assessment of the results of the map composition process. 

2.2.2. Application of the ISO standards 

Among a number of existing approaches for the application of the ISO 
standards the one adopted in the ESDI N program has been selected. The 
main characteristic of this approach is simplicity/ clarity and it is imple- 
mented through the recording of the quality elements/ sub- elements and 
their measures along with the resulting values for each data set. Quality 
assessment will be based on the comparison of the resulting quality values 
with the "conformance levels" provided in the map/ chart specifications. It 
is pointed out that the possibility of using a numerical scale for recording 
the quality results is examined in order to be comprehensive by the average 
user. It is emphasized that the overall approach is valid under the assump- 
tion that the spatial data used in the map/ chart composition process are of 
known and acceptable qual ity for the intended use. 

2.3. Analytical approach 

I n this part the most important phases for map quality assessment are ad- 
dressed: 

a. I dentifi cation and analysis of the map/ chart composition process (model 
generalization, cartographic generalization, symbol izati on, and toponymy) 

b. I dentifi cati on of the features and thei r attri butes i n the spati al data base 
and the map/ chart database which areinfluenced bya specific cartographic 
transformation in each phase of the map composition process: 



o Features 

o Geometric and thematic attributes (Steiniger &Weibel 2007) 

Spatial and thematic relationships (Van Smaalen 2003) 

- Thematic relationships(Similarityand functional relationships) 

- Spatial inter-object relationshi ps (Topological relationships: connec- 
tion, inclusion, neighborhood (Yaolin et al. 2007) and geometric re- 
lationships: comparison with respect to feature geometry) 

At this stage a decision must betaken on the level of application of quality 
elements i.e. whether it will be at the entity level or the dataset level. This 
depends amongst others on the nature of the transformation applied: pro- 
jection transformations influence the whole dataset whereas generalization 
may have local influence changing the characteristics of an entity. 

c. Identification of the quality elements and sub-elements. The quality ele- 
ments and sub-elements of the features, their attributes and the associated 
relationships influenced by cartographic transformations in each phase in 
the map composition process are identified according to ISO 19113. It is 
evident that different quality elements are involved in each transformation. 
On the other hand and for the integrity of the quality model it is necessary 
to identify and measure at least one quality element in each phase. The idea 
here is the correlation of the various transformations with the quality ele- 
ments of the standard in order to relate quality assessment with the result 
of each transformation. 

d. Identification of the conformance levels. Map/ chart specifications refer 
to the conformance levels pertaining to each feature, attribute and trans- 
formation. It is realized though that map/ chart specifications are not com- 
plete and missing values should be identified for each quality element in- 
volved in the process. It is noted though that i n the framework of the devel- 
opment of the map/ char quality model the effort is focused mostly on the 
proper selection of quality elements and their measures and not on the 

1 denti f i cati on of the conformance I evel s. 

e. Assessment of the results. This stage refers to the measured change of 
quality with respect to the conformance levels adopted in each phase of the 
composition process. A considerable difference with the assessment of spa- 
tial data quality is that the checks involved refer to the full data set and not 
to certain samples. At first glance such an approach may seem awkward but 
it is considered necessary for a reliable overall result. 



3. Application on model generalization 

M odd general i zati on i s the f i rst step i n the map/ chart compositi on process 
in digital environment and the first attempt for the development of the 
quality model refers to this stage. For this application the EuroBoundary 
data base is used and generalized for the production of the model Eu- 
roGlobal map database. Due to the extent of the complete quality model its 
presentation will be restricted to the Lake areas feature class (LAKERESA - 
BH080) dataset. The choice of the particular dataset is due to the fact that 
the EuroGlobal map specifications are considered adequate and have been 
tested for years by a number of European mapping agencies. The approach 
followed is based on the definitions for model generalization provided by 
Regnaut and McM aster (2007) and the correlation of the selected quality 
elements of the I SO 19113 with the corresponding operations of model gen- 
eralization. According to Regnault and McM aster (2007) in the framework 
of model generalization the following transformations may be expected: a. 
Generalization of the data schema, b. Change in data categorization and c. 
Modification of the relevant attributes. Model generalization is considered 
as a synthesis of information abstraction (Nyerges 199]) and it is imple- 
mented on: a. the schema level aiming to the transformation of the struc- 
ture of the initial schema and b: the instance level aiming to the transfor- 
mation of the elements in order to be compatible with the resulting data 
base. Quality checks refer to features, their attributes and their relation- 
shi ps. 

3.1. Euro Global Map Data Quality Model 
Process: Model Generalization 

Structural elements of the model: 
3.1.1. Map Specifications 

According to Eurogeographics Specifications (2008) the structural ele- 
ments of the model are: 

a. EGM Conceptual model, descri bes the way data are organized in feature 
classes in the geo-database, defines feature types, includes feature defini- 
tions, attribute definitions, topological and other relationships descriptions. 

b. EGM Logical model is based on DIGEST vector data model which ad- 
heres to the geo-relational data model. Feature geometric primitives are 
Isolated or Connected Nodes, Edges, Faces and the acceptable level of to- 
pology is planar graph (level 2) or full topology (level 3). 

c. Rules for collecting information: The main selection criteria for features 
are the portrayal criteria (e.g. 'Portrayal criteria: Lakes larger than 0.5 km 2 ). 



d. Rules for filtering information: 

- Fuzzy tolerance: 5 meters (topology rule based on specifications). 

- Model generalization rules depend on map scale, e.g. minimum distance 
between two items considered as contiguous: 250 m. 

3.1 .2. Map Quality Requirements: 

They are based on feature definitions and rules for collecting and filtering 
information described in map specifications, e.g. 'QR1 (Selection criteria): 
All lake areas larger than 0.5 km 2 are included i n the dataset'. 

Quality requirement parameters: 

a. Quality scope: implementation field, e.g. 'All items classified as lakeareas 
in the data set'. 

b. Applicable Quality elements (ISO 191B), e.g. 'Completeness/ Commis- 
sion'. 

c. Data Quality Measure (ISO 19138), e.g. 'Id 2 (error count/ number of ex- 
cess item)'. 

d. Data Quality Evaluation Method, e.g. 'Internal check: Count the number 
of items with Shape Area < 0.5 Km 2 '. 

e. Data Quality Conformance Level, e.g. 'Zero violations in dataset'. 

3.1 .3. Map Composition Process - Phases 

a. Analysis and typifi cation of map composition phases, e.g. 'Process: model 
generalization/ Operations: Modification of the class intension, object elim- 
ination (because of the 'modification of the class intension' operation), ob- 
ject aggregation/ merging'. 

b. Determination of map elements and characteristics affected by the opera- 
tions in every phase of map composition process, e.g. model generalization 
operations: 'modification of the class intension affects the entities, 'object 
elimination affects the entities and the topological relationships, object ag- 
gregati on/ mergi ng affects the attri butes'. 

3.1 .4. Additional elements of map composition process: 
Software used ArcGis ver. 10.1 

3.1 .5. Map quality control, includes two stages: 

a. Determination of the applicable quality elements (I SO 19113) affected by 
the operations in every phase of map composition process, e.g. model gen- 
eralization operations: 'modification of the class intension affects the quali- 



ty element/ sub element of completeness/ commissi on, 'object elimination 
affects the quality element/ sub- element of logical consistency/ topological 
consistency, object aggregation/ merging affects the quality element/ sub- 
element of thematic accuracy/ non-quantitative attribute correctness'. 

b. Quantification of quality variation and aggregation of data quality results 



Feature type/ 
Attribute 


Quality 
Element/ 
Sub element 


Quality Measure 


Description 


LAKERESA 
(BH080) 


Completeness/ 
Commission 


Error count /id 2 


Scope: All items classified 
as "LAKERESA" in the 

rlatacot 
Udldocl. 


rcdlUI c LJk3 II 1 II UUI 1 . 

A body of water 
surrounded by land 




Mi imhor nf ov. 
INUIIIUfcM Ul CA 

cess items (Full 
inspection) 


IVItfac>Ui tt. MM laftt; altfdo 

larger than 0.5 km2. 








Measure definition: Number 
of excess items in the da- 
taset in relation to the num- 
ber of items that should 
have been present. 








Evaluation method descrip- 
tion: Count the number of 
items with 

Shape_Area < 0.5 Km2. 








Evaluation method type: 
Internal 








Result value type: Integer 








Result unit: Number 








Conformance level: Zero 
commissions in dataset 



Table L Quality element, measure and conformance level for feature LAKERESA 



3.1.6. Knowledge management: 

■ I mplementation of the mini mum required quality controls 

■ Possible redefinition of conformance levels 

■ Repetition of each phase of map composition process to obtain results 
compliant to map specifications, excluding algorithms that affect in an 
i nappropri ate way the enti re process 

■ Identification of the relation between the parameters of each transfor- 
mation and the quality variation 

■ Determination of the degree of the transformations impact on map fea- 
tures and characteristics 



4. Results 

The results of model generalization of the hydrographic network are por- 
trayed in figures 2 and 3. Figures land 2 portray the hydrographic network 
in its original form and after model generalization at the 250.000 scale. 
Figure 3 portrays the result of model generalization at the EGM scale 
11000.000. These figures show that the application of the quality model 
described are realistic and that the resulting cartographic database can be 
utilized undoubtedly as an input to subsequent stages of map composition. 
For these stages another model for quality assessment will be developed. 



5. Conclusions 

An approach to the assessment of map/ chart quality is considered feasible. 
This can be considered as a step towards cartographic process integration. 
A common quality model can be defined which can be used by map produc- 
ers. Such a model will lead to a quantified overall assessment of map/ chart 
quality. The authors believe that a trusty indication of quality on the maps 
produced will contribute to the standardization of the map composition 
process and the improvement of the reliability of cartographic products. It 
will also enable map users to look for those maps that fulfil their needs for 
the applications they are involved in. 



Figure L EuroRegional Map - Hydrographic network (original data), 
scale 1250.00 




Figure 2. EuroRegional Map - Hydrographic network after model gener- 
alization, scale 1250.000 




Figure 3. EuroRegional Map - Hydrographic network after model gen- 
eralization, scale 11000.000 
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